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Abstract 

We report on experimental studies of synchronization phenomena in a pair 
of analog electronic neurons (ENs). The ENs were designed to reproduce the 
observed membrane voltage oscillations of isolated biological neurons from the 
stomatogastric ganglion of the California spiny lobster Panulirus interruptus. 
The ENs are simple analog circuits which integrate four dimensional differen- 
tial equations representing fast and slow subcellular mechanisms that produce 
the characteristic regular/chaotic spiking-bursting behavior of these cells. In 
this paper we study their dynamical behavior as we couple them in the same 
configurations as we have done for their counterpart biological neurons. The 
interconnections we use for these neural oscillators are both direct electrical 
connections and excitatory and inhibitory chemical connections: each realized 
by analog circuitry and suggested by biological examples. We provide here 
quantitative evidence that the ENs and the biological neurons behave similarly 
when coupled in the same manner. They each display well defined bifurca- 
tions in their mutual synchronization and regularization. We report briefly on 
an experiment on coupled biological neurons and four dimensional ENs which 
provides further ground for testing the validity of our numerical and electronic 
models of individual neural behavior. Our experiments as a whole present inter- 
esting new examples of regularization and synchronization in coupled nonlinear 
oscillators. 
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I. INTRODUCTION 



Synchronization of nonlinear oscillators is widely studied in physical and biological sys- 
tems for underlying interests ranging from novel communications strategies to un- 
derstanding how large and small neural assemblies efficiently and sensitively achieve desired 
functional goals |^. The analysis of biological systems may, beyond their intrinsic interest, of- 
ten provide physicists with novel dynamical systems possessing interesting properties in their 
component oscillators or in the nature of the interconnections. 

We have presented our analysis of the experimental synchronization of two biological neu- 
rons as the electrical coupling between them is changed in sign and magnitude 0. Subsequent 
to that analysis we have developed computer simulations of the dynamics of the neurons which 
are based on conductance based Ho dgkin- Huxley (HH) |^ neuron models. These numerical 
simulations quantitatively reproduced the observations in the laboratory [|6|,p|-p!0[] . 

The study of isolated neurons from the stomatogastric ganglion (STG) of the California 
spiny lobster Panulirus interruptus using tools of nonlinear time series analysis shows 
that the number of active degrees of freedom in their membrane potential oscillations typically 
ranges from three to five 0. The appearance of low dimensional dynamics in this biological 
system led us to develop models of its action potential activity which are substantially simpler 
than the HH models we and others have used to describe these systems. We adopted the 
framework established by Hindmarsh and Rose (HR) [|l^] in which the complicated current 
voltage relationships of the conductance based models are replaced by polynomials in the 
dynamical variables, and the coefficients in the polynomials are estimated by analyzing the 
observed current /volt age curves for the neurons under study. 

Building on biological experiments and on numerical analysis of models for the oscillations 
of isolated neurons, we have constructed low dimensional analog electronic neurons (ENs) 
whose properties are designed to emulate the membrane voltage characteristics of the individ- 
ual neurons. Using these simple, low dimensional ENs we report here their synchronization 
and regularization properties, first when they are coupled electrically as the sign and magni- 
tude of the coupling is varied, and then when they are coupled by excitatory and inhibitory 
chemical synapses. We have also studied the behavior of an hybrid system, i.e., one EN and 
one biological neuron coupled electrically. As our models were developed on data acquired 
from biological neurons in synaptic isolation, the results we present here on pairs of interacting 
ENs and hybrid systems serve to provide further confirmation of the properties of those model 
neurons, numerical and analog. 



We have studied and built three dimensional and four dimensional models of HR type 
having the form 



II. THE ELECTRONIC NEURON MODEL 



dx(t) 
dt 



ay{t) + 6x^(t) - cx^{t) - dz{t) + / 



dy{t) 



e - fx\t) - y{t) - gw{t) 



dt 
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^ = ^^{-z{t) + S{x{t) + h)) 
^ = ui-kw{t) + r{y{t) + l)), 



where a, b, c, d, I, e, /, g, /i, S, h, z/, k, r and / are the constants which embody the underlying 
current and conductance based dynamics in this polynomial representation of the neural dy- 
namics. x{t) is the membrane voltage in the model, y{t) represents a "fast" current in the 
ion dynamics, and we choose /i <C 1, so z{t) is a "slow" current. Taken alone the first three 
equations of the model can reproduce several modes of spiking-bursting activity observed in 
STG cells. The first three equations were used in analog realization for our earlier experiments 
with 3D ENs HI 



The equation for w{t) represents an even slower dynamical process (z/ < /i ^ 1), and 
it is included because a slow process such as the calcium exchange between intracellular 
stores and the cytoplasm was found to be required in Hodgkin-Huxley modeling p| to fully 
reproduce the observed chaotic oscillations of STG neurons. Both the three dimensional and 
four dimensional models have regions of chaotic behavior, but the four dimensional model has 
much larger regions in parameter space where chaos occurs, presumably for many of the same 
reasons the calcium dynamics gives rise to chaos in HH modeling. The calcium dynamics is an 
additional degree of freedom with a time constant three times slower than the characteristic 
bursting times. 

In our analog circuit realization of the EN model we used a = 1, 6 = 3, c = 1, = 0.99, / = 
3.024, e = 1.01,/ = 5.0128,^ = 0.0278, /i = 0.00215,5 = 3.966, /i = 1.605, i/ = 0.0009, = 
0.9573, r = 3.0 and / = 1.619. The implementation of these constants in analog circuits always 
has about 5% tolerance in the components. The main parameters we used in controlling the 
modes of spiking and bursting activity of the model are the DC external current I and the 
time constants /x and v of the slow variables. 

Figure |l] shows a chaotic time series of the four variables using the parameters above. Note 
how w modulates the length of the bursts in x. Each local minimum in the global oscillations 
of w coincides with a short burst period. The complexity achieved by the addition of w 
can be observed in the projections of (x, 2;, w) space to various three-dimensional spaces, 
(x, z), (x, y, w) and {x, z, w) respectively, as shown in Figure ^ 



Table 1 presents the Lyapunov exponents Aj calculated from the vector field [|T5| of Equa- 
tion( |I|) for the 3D and 4D ENs. A positive Lyapunov exponent is present in both models, 
indicating conclusively that they are oscillating chaotically. From this spectrum of Lyapunov 
exponents, we can evaluate the Lyapunov dimension Dl which is an estimate of the fractal 
dimension of the strange attractor for the ENs [|lT|. The Lyapunov dimension is defined by 
finding that number of Lyapunov exponents Aj satisfying 

N N+l 

J2Xi>0 ; while A, < 0. (2) 



1=1 i=l 



Then -D^ is defined as 



\Xn+i\ 

Dl for each EN is displayed in the last column Table 1. 



A 

Dl = N+ ^;=^ (3) 
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Model: 


Ai 


A2 


A3 


A4 


Dl 


3D 


0.010 


0.000 


-7.752 




2.001 


4D 


0.004 


0.000 


-0.001 


-8.034 


3.000 



Table 1: Lyapunov exponents Aj and Lyapunov dimension Dl calculated from the vector field 
(Equation( ||)) for the 3D and 4D electronic neuron models. As a reminder to the reader: the sum 
of all Lyapunov exponents must be negative, and this is so for our results. Also, one Lyapunov 
exponent must be as we are dealing with a differential equation. 



III. ANALOG IMPLEMENTATION OF THE ENS 

We designed and built an analog electronic circuit which integrates Equation ([^). We chose 
to build an analog device instead of using numerical integration of the mathematical model on 
the CPU of a PC or on a DSP board because digital integration of these equations is a slow 
procedure associated with the three different time scales in the model. Furthermore, a digital 
version of an EN requires digital to analog and analog to digital converters to connect the 
model to biological cells. Analog circuits are small, simple and inexpensive devices; it is easy 



to connect them to a biological cell, as we discuss below (see also In a practical sense 

nearly an unlimited number of them can work together in real-time experiments. Finally, 
looking ahead to the construction of real-time networks of large number of these neurons, 
analog implementation is a necessity. 

The block diagram of the analog circuit we use to represent the three dimensional and the 
four dimensional ENs is shown in Figure (|^). It includes four integrators indicated by / dt, two 
multipliers, two adders, and two inverters. We used off-the-shelf general purpose operational 
amplifiers. National Instruments Model TL082, to build the integrators, adder and inverter 
and used Analog Devices Model AD633 as analog multipliers. The integrator at the top of 
the diagram receives all components of e.g. ay{t), bx{t)^, etc. It has an additional input 
(called in) which can be used for connections with other circuits or neurons. The integrators 
invert the sign of their input, so the output signal will be —x{t) multiplied by a time constant 
T chosen to make the EN oscillate on the same time scale as the biological neurons. The signal 
—x{t) is used to generate the nonlinear functions x^(t) and x^{t) and these values go to the 
second and third integrators. Similarly, the other integrators generate voltages proportional 
to y{t), —z{t), and w{t). A renormalization was made in the rest of the time constants in the 
circuit to make r = 1. Note that this rescaling is responsible for the different amplitudes in 
the numerical (Figure |l|) and analog (Figures |^, |, |^, |, |) experiments. 

This circuit design allows us to easily switch from a three dimensional to a four dimen- 
sional model of the neuron. We can connect or disconnect one wire, indicated as point 'a' in 
Figure H, to enable or disable the circuit block shown in the rectangle with a dashed outline. 
In Equation(|I]) this corresponds to setting g = in the equation. 

The block indicated as NA in Figure |^ is an adjustable nonlinear amplifier. We use it to 
rescale and change the shape of the output signal x{t). It can shrink or stretch different parts 
of the waveform, change the amplitude and move the trace as a whole up or down. This shape 
adjustment is particularly important in experiments with groups of biological and electronic 
neurons interconnected with each other. Living neurons, even taken from the same biological 
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structure, may generate considerably different waveforms. The relative size of spikes and the 
interburst hyperpolarization is variable from cell to cell. In our circuits we can precisely adjust 
the waveform of the EN to be very close to that of each biological neuron in our experiments. 

Another reason to use circuits with variable waveforms is that it opens up the possibility 
of studying how the action potential waveforms affect the interactions among the neurons, 
electronic and biological. Indeed, the ability to vary the details of the waveforms provides an 
interesting handle on design of biometric circuitry for a variety of applications. 



IV. SYNAPTIC CONNECTIONS BETWEEN ENS 

In living nervous systems one finds three general types of synaptic connections among 



neurons 



]TB|: ohmic electrical connections (also called gap junctions) and two types of chemical 
connections, excitatory and inhibitory. For our studies of the interconnections among ENs and 
among ENs and biological neurons [Q, we built electronic circuits to emulate excitatory and 
inhibitory synaptic connections as well as the ohmic electrical connections. The STG neural 
circuits are dominated by inhibitory interconnections and by ohmic electrical connections. We 
now describe how we implemented each, and then we turn to the results of our synchronization 
experiments with these network connections. 



A. Implementation of the Electrical Synapses 



We implemented an electrical synapse [17| between the ENs by injecting into one of the 



neurons (ENi) a current proportional to the voltage difference between the two membrane 
potentials of the ENs and into the other neuron {EN2) injecting the same current but with 
the opposite strength. The current into ENi is 

hit) = ^(x^it) - 
while hit) = -hit). 

We chose the dimensionless synaptic strength G^; in the range Ge G [—1,1]. Over this 
range we observed the effects of positive and negative electrical coupling on the spiking and 
bursting behavior of the ENs. We recorded the electrical voltage signals corresponding to the 
membrane potentials of the ENs using an analog to digital converter with a sampling rate of 
5 kHz. For each value of we waited at least 40 seconds to avoid transient dynamics and 
then recorded a data series 20 seconds long. 

Natural biological networks do not have negative conductance electrical coupling. Using 
an active device placed between the neurons we implemented negative electrical couplings in 
our experiments on two electrically coupled biological neurons as reported in 0. To compare 
the results of our work there with the properties of coupled ENs, we use negative coupling 
here as well. 



B. Implementation of the Chemical Synapses 



We first implemented mutual chemical synapses between the two ENs using analog cir- 
cuitry. Here we report on results obtained by using a software implementation of the chemical 
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synapses which allows to investigate the role of the synaptic time constant r^. In the analog 
circuit implementation of the chemical synapses we need to replace a capacitor every time 
we want to change the time constant, but in the software version this time constant is just a 
parameter, so it is easier to study the role of these time constant in the software version. In 
this paper the time constant is fixed, and our observations on the role of a changing time con- 
stant will be reported in another paper. The results using a software version of the chemical 
synapse, and the results using our hardware version were identical. 

We used the nonlinear amplifiers to reshape the signals corresponding to the membrane 
potential of the ENs in such a way that the new signals had amplitudes, spike/burst ratios, and 
voltage offsets close to the the signals generated by living neurons. With these reshaped signals 



we used new dynamic clamp software to generate in real time the currents corresponding 



to the graded chemical synapses as described the by first-order kinetics 

/c = 213a5(t)(a;rev-Xpost), (4) 



and 



where 



:i-S^)T,^ = {S^-Sit)) (5) 



5oo(xpre)=tanh[^P^:^^], (6) 
^slope 

when xpre > a^th' Otherwise 6*00 (xpre) = 0. 

Gc is the maximal synaptic conductance, S{t), the instantaneous synaptic activation, 5*00, 
the steady-state synaptic activation, Xrev, the synaptic reversal potential, and Xpre and x-pQ^^ 
are the presynaptic and postsynaptic voltages respectively, is the synaptic time constant, 
x^YiJ the synaptic threshold voltage, and a^g^Qp^, the synaptic slope voltage. 

The synaptic reversal potentials were selected so that the currents injected into the postsy- 
naptic ENs were always negative for inhibitory synapses and positive for excitatory synapses, 
emulating the biological synapses [0 . The synaptic threshold voltages were set in the middle 
of the amplitude of the bursts, and the synaptic slope voltage was adjusted to make the output 
of the hyperbolic tangent slightly saturated at the spikes. In our experiments Gc was varied 
as we collected different data sets. We used standard values for the other parameters in the 
dynamic clamp program: Xrev = —80mV (inhibitory synapses) or Xrev = —20mV (excitatory 
synapses); = 10ms; x^^ = — 50mV^; and a;gjQpg = 10m V^. As before we waited for at least 
40 seconds after connecting the ENs with the chemical synapses before starting the recording 
of the 20 seconds of data from the membrane potential of the ENs. 



V. EXPERIMENTS 



To analyze the degree of synchronization of slow bursts between two coupled neurons 
(electrically or chemically) we proceed in the same manner as we used for our experiments on 
synchronized living neurons . This was based on a method developed for the experimental 
studies of synchronization of chaotic oscillations in electronic circuits [p!9| -|21[|. We used an 
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overlap-add method of FIR filtering with a Hamming window, and used an FFT and a cutoff 
frequency of 5Hz to suppress the spikes, obtaining the filtered data series x{ (t); i = 1,2. The 
synchronization of the ENs is quantified by calculating the difference x{i{t) = — x^it), 
and studying the normalized standard deviation = a f/a / and the normalized maximal 

ma "^^ 

I {^\™^^ — a;{'™™) as a function of G^; for the electrical coupling or as 
'or the chemical coupling. For notational convenience, we indicate excitatory 



deviation A^r = 
a function of Gc 



couplings with values of Gc > and inhibitory couplings with values of Gc < 0. 



A. Isolated Neurons: 



The parameters of the isolated neurons were set in the chaotic spiking-bursting regime. 
An example of the behavior of an isolated EN is shown in Figure |^. Note that the scale for 
X is double that of the numerical simulations shown in Figure because of the rescaling time 
constant in the analog integrator (see section |nT|) . The relative behavior of the spikes and 
slow oscillations can be seen in the plots of X2 vs. xi (Figure ^|A) and x^ vs. xl (Figure | 
respectively. 



B. Electrical Coupling Between Two ENs 



We began with electrical coupling between two four dimensional analog circuit models im- 
plementing Equation(|l]). We varied only Ge keeping all other parameters fixed. A convenient 
representation of the range of behavior we observed is presented in Figure ^ Here, overlying 
values of aNiGs) and An{Ge) we give a verbal description of the quantitative behavior of 
time series in each regime. To illustrate the phenomena seen in each regime Ge G [—1, 1] of 
Figure ^ we show examples of the time series for the membrane potentials xi{t), X2{t) of the 
two neurons in Figures ^ and 



1. Results for 0< Ge < 1 

• When Ge ~ 0.0 the two neurons are uncoupled and display independent chaotic oscil- 
lations as shown in Figure 0. 

• For small, positive coupling 0.0 < Ge < 0.2, regions of nearly independent chaotic 
spiking-bursting activity are observed as well as some regions of synchronized bursting 
activity as shown in Figure |^(B) where we set Ge = 0.1. There is a small range of Ge 
[Ge ~ 0.05) in which intermittent anti-phase bursting behavior can be found. The burst 
length in this case is kept nearly regular from burst to burst as shown in Figure ^(A). 

• For 0.2 < Ge < 0.3 the behavior is still chaotic for the two neurons but most of the 
bursts are synchronized as shown in Figure |^(C) where we set Ge = 0.2. 

• From 0.3 < Ge < 0.8 the bursting activity becomes regular going from a region in which 
there is partial synchronization (spikes not synchronized), as shown in Figure §(D) where 
we set G^; = 0.3, to a region of total synchronization (bursts and spikes synchronized), 
shown in figure ^(E) where we set G^; = 0.6. 



7 



• From 0.8 < Ge < 1-0 there is total synchronization in the spiking-bursting activity, and 
the oscillations are chaotic as shown in figure ^(F) where we set G^; = 0.9. 

Results for -1 < < 

• For negative coupling Ge < 0, the oscillations are predominantly chaotic and the hy- 
perpolarizing regions, where the membrane voltage is quite negative, of the signals are 
all in anti-phase. The average burst length decreases as the coupling becomes stronger 
as shown in Figure ^. For a small range of Ge {Ge ~ —0.02) very long bursts were 
observed as shown in Figure §|(A). 

2. Comparison of Coupled ENs 
with Electrically Coupled Biological Neurons 

(Tn{Ge) and Ai<^{Ge) provide quantitative measures of the synchronization between two 
ENs. In our report on the experimental work |^ with two biological cells, the results for 
<^n{Ge) and A]\r{GE) can be seen in Figure 5 of that paper. Note that, as in the case of 
coupled biological neurons, we have here a bifurcation between positive and negative electrical 
coupling. In the experimental work on electrically coupled biological neurons a value for the 
external coupling Qa ~ — 200nS serves to null out the natural coupling of about that amount, 
so the figures here and in the earlier paper are to be compared by sliding Ge = here 
to Qa ~ —200 nS there. Both in the biological and electronic experiments, the sharp phase 
transition from very small aN,AN for positive coupling to large, nearly constant values is 
associated with the rather rapid change from nearly and then fully synchronous behavior for 
positive couplings to out-of-phase oscillations for negative couplings. 

The (T7v(G£;) and Aj^{Ge) curves in the paper on coupled biological neurons shows 
far fewer points and consequently less detail that our curves for coupled 4D ENs. Clearly 
this is because of the resolution in the biological experiments and the difficulty in performing 
experiments at such closely chosen values of Ge- At this time the details of behavior revealed 
in the present experiments on ENs have not been verified in the biological setting. One should 
view our Figure ^ and Figure 5 of as in excellent qualitative agreement. 

C. Chemical Synapses Between Two ENs 

We have observed the behavior of two four dimensional ENs coupled with identical chemical 
synapses. Two electrical versions of chemical synapses were built with identical parameters 
and then used to coupled two four dimensional ENs. In the equations. Equation (j^), we 
integrate to represent the chemical synapse, all parameters were set equal in the two connecting 
circuits. We then varied Gc in each chemical synapse over the range < Gc < 200 nS for 
an excitatory synapse, namely Xrev = — 20m^, and over the range < Gc < 500 nS for 
an inhibitory synapse, namely, Xrev = — 80m^. The other parameters were held fixed at 
Ts = lOms, x^Yi = —50mV, and a^gjQpg = lOmV. In Figure |^ we collect the statistical results, 
expressed in our usual quantities <7^{Gc) and Ajy^Gc), for both excitatory and inhibitory 
synaptic connections. Negative values of Gc represent inhibitory connections. This, perhaps 
apparently peculiar, method of presentation allows us to see immediately the relationship 
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between excitatory and inhibitory interconnections. As earlier with electrical couplings we 
provide a verbal description of each region of behavior over the whole range of Gc- We show 
examples of the time series for the membrane potential x of the two neurons in Figure ^ and 
Figure ^j. 

1. Excitatory Chemical Synapses 

When coupled with implementations of excitatory chemical synapses the ENs displayed 
the following behaviors: 

• When Gc ~ OnS the two neurons are uncoupled and display independent chaotic oscil- 
lations as shown in Figure 

• For positive coupling < Gc < lOOnS a transition from the chaotic behavior to reg- 
ular spiking/bursting is observed. For small coupling the independent chaotic spik- 
ing/bursting activity of the uncoupled neurons is replaced by a behavior in which most 
of the bursts are synchronized, but the oscillations are still chaotic as shown in Fig- 
ure |^(A) for Gc = lOnS. As Gc is increased all the bursts become synchronized, and 
the activity becomes periodic as shown in Figure ^(B) for Gc = lOOnS. 

• For Gc > looks' the bursts remain synchronized and get longer, but there are no longer 
any spikes during the bursts as shown in Figure |^(C) for Gc = 200nS. 

2. Inhibitory Chemical Synapses 

Finally we report on our experiments with an electronic version of an inhibitory chemical 
synapse. This inhibitory synaptic coupling occurs in the lobster pyloric CPG as well as 
many other CPGs, and we have suggested that inhibitory chemical coupling will lead to 
regularization of the chaotic oscillations of the individual neurons. 

• For small Gc the oscillations are still chaotic, but all of the hyperpolarizing regions of 
the membrane voltages are in anti-phase as shown in Figure ^(A) for Gc = 8nS. 

• When Gc ~ 20nS the oscillations become periodic, and all the hyperpolarizing regions 
are in out-of-phase as shown in Figure |(B). 

• For 25nS < Gc < 50nS the out-of-phase behavior of the hyperpolarizing regions remains, 
but the oscillations are chaotic again as shown in Figure ^(C) for Gc = 25nS. 

• For bOnS < Gc < 150nS the oscillations regularize again, and the behavior is periodic 
with out-of-phase bursting as shown in Figure P(D) for Gc = 50nS and in Figure ^(E) 
for Gc = lOOnS. 

• For Gc > 150nS the oscillations are chaotic and long out-of-phase bursts are observed 
as shown in Figure 0(F) for Gc = SOOTS'. 
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The only experiments we know which relate to these observations on two chemically cou- 
pled ENs are not a precise match, but bear noting. R. Elson has isolated a pair of LP 
and PD neurons from the lobster Pyloric CPG; these have mutual inhibitory coupling. Elson 
varied the strength of the chemical coupling using neuromodulators and making measurements 
at four values of Gc over a nominal rage of 20 nS to 60 nS. He observed only the behavior 
reported in the penultimate item of our experiments on inhibitory coupling. Unfortunately, 
control of the identity of the mutual inhibitory couplings was not possible, nor was it possible 
for us to directly compare the calibration of Elson's indication of the magnitude of Gc with our 
own choices in using ENs. To date then, we have no direct laboratory evidence on synchro- 
nization of biological neurons mutually coupled with chemical synapses. This is in contrast to 
our observations on electrically coupled biological neurons 0. This represents an interesting 
opportunity for biological experiments which may be directly compared to our results using 
ENs. 



D. Coupling Between Electronic and Living Neurons 

We have previously reported experiments on replacing the AB neuron from the Pyloric 



CPG in its interaction with an isolated pair of PD neurons with a three dimensional EN |]14 
For completeness in light of the work reported in this paper, we carried out an experiment in 
which one of our four dimensional neurons was coupled bidirectionally to one of the PD neurons 
in the AB/PD pacemaker group of the Pyloric CPG. The full description of the methods used 
in the biological preparation will appear elsewhere but here we quite briefly summarize 



those points important to the main thrusts of this article. 

These experiments were carried out on one of the two pyloric dilator (PD) neurons from 
the pyloric central pattern generator (CPG) of the lobster stomatogastric ganglion (STG) | ]22| . 
The STG of the California spiny lobster, Panulirus interruptus, was removed using standard 
procedures and pinned out in a dish lined with silicone elastomer and filled with normal lobster 
saline. The STG was isolated from its associated anterior ganglia, which provide activating 
inputs, by cutting the stomatogastric nerve. Two glass micro electrodes were inserted in the 
soma of the PD neuron: one for intracellular voltage recording and another one for current 
injection. The voltage signals were digitized at 10000 samples/sec. The two PD neurons 
remained coupled to each other and to the autonomously bursting interneuron (AB) by their 
natural electrical synapses, but were isolated from the rest of the CPG by blocking chemical 
input synapses with picrotoxin (7.5/iM). The artificial electrical coupling was provided by 
injecting in the EN and in the PD opposite currents. More details of the experimental setup 
can be found in fl^. The membrane voltage of the EN was reshaped to make its amplitude 
ratio in spiking/bursting mode, its total amplitude and its voltage offset similar to those of 
the PD neuron. Only electrical coupling, positive and negative, is reported here. 

We connected the neurons with the analog electrical synapse and observed their spiking- 



bursting behavior as shown in Figure |T0|. When uncoupled, the neurons had independent 
spiking/bursting activity as shown in Figure |r^(B). For large enough negative coupling the 
neurons are synchronized and fire out-of-phase as shown in Figure |10|(A). For positive coupling 
the neurons show synchronized bursting activity as shown in Figure [TD|(C). For this value of 
Ge the bursts are synchronized but not the spikes. 
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This result is in agreement with the experiments made with a pair of electrically coupled 
ENs, as we discussed above, as well as for a pair of living STG neurons 0. 

VI. DISCUSSION 

The ENs described in this paper are simple analog circuits which integrate four dimen- 
sional differential equations representing fast and slow subcellular processes that give rise to 
the characteristic spiking and spiking-bursting behavior of CPG neurons. The single neurons 
can be easily set into a chaotic regime that reproduces the irregular firing patterns observed 
in biological neurons when isolated from the rest of the CPG. This study comprises: (a) two 
electrically coupled ENs and (b) two ENs connected with excitatory and inhibitory chemical 
synapses. These two types of connections exist in almost all known CPGs. The range of 
observations summarized in Figures ^ and |^ shows the rich behavior and complexity of these 
minimal network configurations. It indicates how small changes in the coupling conductance 
can drive the cells into completely different regimes. In particular, some of our experiments 
predict the appearance of chaotic out-of-phase synchronization for different coupling configu- 
rations. These results are displayed in Figures ^fJ and In general, the experiments with 
the ENs contribute directly to our understanding of the origin of regularization of individually 
chaotic neurons through cooperative activity. 

How complicated should one require a model neuron to be? In our view the answer depends 
on the neural function one wishes to represent. The analysis of the electrical activity of isolated 
neurons from the lobster Pyloric CPG indicates that the number of active degrees of freedom 
is not very large, ranging from three to five in various environments, and this suggests a 
very simple representation in terms of dynamical equations. Our analysis |^ of much richer 
Hodgkin-Huxley models of these individual neural oscillators also indicates that in the regime 
of biological operation, the number of active degrees of freedom is equally small. On this basis 
we developed the Hindmarsh-Rose type models of these neurons both in numerical simulation 
and in analog electrical circuitry. 

This paper has moved that inquiry about the complexity of representation for the com- 
ponents of a biologically realistic neural network to another level. Here we have investigated 
whether the simplified neural models, when coupled together in small networks, but in biolog- 
ically realistic manners, can reproduce our observations biological neurons alone. The striking 
result of the observations presented here, when the experimental setup matches that of the 
biological networks, is that the observed behavior of the ENs also matches. Further, using 
our ENs, we are able to make distinct predictions about the behavior of biological or hybrid 
(biological and EN) networks in settings not yet investigated. 

Our experiments on coupled biological neurons and ENs provide further ground for test- 
ing the validity of numerical and electronic models of individual neural behavior as well as 
presenting interesting new examples of coupled nonlinear oscillators. Hybrid circuits with 
biological and electronic neurons coupled together are a powerful mechanism to understand 
the modes of operation of CPGs. The hybrid system constitutes an easy way to change the 
connectivity and global topology of the CPG. The roles of intrinsic dynamics of the neurons 
and the synaptic properties of the network in rhythm generation can be easily studied with 
these hybrid configurations [Q)- 
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There are previous efforts studying electronic neurons alone and in conjunction with biolog- 
ical neurons. An early example is the work of Yarom where a network of four oscillators, 
realized as an analog circuit, was interfaced with an olivary neuron in a slice preparation. 
Yarom studied the response of the olivary neuron when it received oscillating electrical in- 
put from the network. There was no feedback from the biological neuron to the network 
he constructed. Le Masson, et al [^] developed a digital version of a neuron comprising a 



Hodgkin-Huxley (HH) model of various pyloric CPG neurons with three compartments and 
eight different ion channels which ran on a DSP board located on the bus of a personal com- 
puter. They connected this model into a variety of different configurations of subcircuits of 
the pyloric CPG replacing at various times the LP, a PD or a PY neuron. Using this 'hybrid' 
setup they verified that many aspects of the pyloric rhythm are accurately reproduced when 
their DSP based neuron replaces one of the biological neurons in their system. In subsequent 



work ||27| , |28[| , this group has developed VLSI devices for integrating the HH models and has 
utilized them in mixed circuits (ENs and biological neurons), replacing the DSP version of 
the conductance models in their biological preparations. The complexity of these ENs has 
not been needed in our modeling nor in the further experiments on their interaction with 
each other as reported here. We have not found any reports in the literature on the mutual 
interaction of these analog VLSI neural circuits. 

There are two interesting directions to which the results reported here may point: 

• (1) biologically realistic neural networks of much greater size than the elementary ones 
investigated here may be efficiently investigated numerically or in analog circuitry using 
the realistic, but simple HR type models. The integration of the model equations is no 
challenge to easily available computing power and large networks should be amenable 
to investigation and analysis. 

• (2) The networks investigated here are subcircuits of a biological circuit of about fifteen 
neurons which has the functional role of a control system: commands are presented from 
other ganglia of the lobster and this Pyloric circuit must express voltage activity to the 
muscles to operate a pump for shredded food passing from the stomach to the digestive 
system. Many other functions are asked of biological neural networks. Using the full 
richness of HH models for the component neurons may seem attractive at one level, but 
the results presented here suggest that many interesting questions may be asked of those 
networks using the simplified component neurons studied here. 
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FIG. 1. Time series of the dynamical variables x{t),y{t), z{t),w{t) of our four dimensional HR 
model, Equation(ll), and various three-dimensional projections {x{t),y{t), z{t)), {x{t),y{t),w{t)) and 
{x{t), z{t),w{t)) of the four dimensional phase space orbits.. 
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FIG. 2. Block diagram for the four dimensional HR neuron used in our experiments. These 
neurons were designed to replicate the behavior of individual, isolated neurons from the lobster 
STG. In our experiments they were coupled electrically as well as via an electronic implementation 
of inhibitory and excitatory chemical synapses. 



14 



- mi 

mi o . ■ ■ ■ 




FIG. 3. Regimes of oscillations in two uncoupled electronic neurons (ENs). (A) Time series of 
the membrane voltages xi{t),X2{t) for the uncoupled ENs. (a) Phase space portraits of X2{t) vs. 
xi{t). (B) Membrane potentials after 20Hz low-pass filtering to emphasize the bursting behavior, 
(b) Phase space portraits of filtered membrane potentials X2{t) vs. Xi{t). 
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FIG. 4. Normalized standard deviation aN{GE) and normalized maximal deviation /S.n{Ge) 
computed after 20Hz low-pass filtering the membrane potential of two electrically coupled ENs for 
different values of the synaptic conductance Ge- For small positive electrical coupling {Ge >~ 0) the 
behavior of the ENs is nearly independent and chaotic. Intermittent out-of-phase bursting activity 
was observed in the range labeled as lA in the diagram for the two coupled ENs with Ge = 0.05. 
A transition from chaotic to periodic behavior occurs for 0.2 < G^; < 0.3 in which the chaotic 
oscillations are replaced by synchronized bursting activity. In the interval 0.3 < Ge < 0.8 smooth 
synchronization of the spikes occurs, and for Ge > 0.8 the oscillations become chaotic but now with 
both bursts and spikes synchronized. For negative coupling the oscillations arc always chaotic and 
the hyperpolarizing regions are in out-of-phase . There is a decrease in the average burst length as 
the negative coupling become stronger. For a very small negative coupling an intermittent behavior 
in which the ENs showed very long and simultaneous bursts was observed. This is the region labeled 
as IP for Ge = -0.02. 
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FIG. 5. Positive electrical coupling of two chaotic ENs. Characteristic time series of the mem- 
brane potentials xi{t),X2{t) (figure labels A through F) as we vary Ge- Phase portrait X2{t) vs. xi{t) 
(figure labels al through fl). Phase protraits after 20Hz low-pass filtering x^it) vs. .x{(t) (figure la- 
bels a2 through f2). (A) Ge = 0.05-intermittent out-of-phase bursting activity. (B) Ge = 0.1-nearly 
independent chaotic spiking-bursting pattern. (C) Ge = 0.2-chaotic oscillations with most bursts 
synchronized. (D) Ge = 0.3-periodic oscillations with partial synchronization of the ENs, the spikes 
are not synchronized. (E) Ge = 0.6 — periodic oscillations with the complete synchronization of the 
ENs. (F) Ge = 0.9-chaotic but completely synchronized oscillations. 
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FIG. 6. Negative electrical coupling of two chaotic ENs. Characteristic time series of the mem- 
brane potentials xi{t), X2{t) (figure labels A through C) as we vary Ge- Phase portraits of X2{t) 
VS. xi{t) (figure labels bl and cl). Phase portraits after 20Hz low-pass filtering (t) vs. x{(t) (fig- 
ure labels b2 and c2). (A) Ge = — 0.02-intermittent simultaneous long bursts in the two ENs. (B) 
Ge = — 0.2-chaotic out-of-phase spiking-bursting behavior. (C) Ge = — 0.9-fast chaotic out-of-phase 
spiking-bursting behavior. The time scale used in the time series plot is the same for all examples. 



19 



2.5 



periodic 



.S o. 

in " 



most 
liyperpol. 
regions 
1 in pliase 



periodic 



bursts in 
phase 



C) 1.0- 




burst 
frequency 
decreases _ 



200 



(nS) 

FIG. 7. Normalized standard deviation ajqiGc) and normalized maximal deviation Ajv(Gc) com- 
puted after 20Hz low-pass filtering in the membrane potential of two ENs coupled with identical 
chemical synapses for different values of the synaptic conductance Gc for both excitatory {Gc > 0) 
and inhibitory (Gc < 0) connections. For very small excitatory coupling (Gc ~ 0) the behavior of the 
ENs is nearly independent and chaotic. As soon as the strength of excitatory coupling is increased 
most of the hyperpolarizing regions are in phase, and, eventually, for Gc = loons' the oscillations 
are periodic and the bursts are synchronized. The length of the bursts increases as we increase the 
coupling to Gc > lOOnS. For small inhibitory Gc the oscillations are chaotic but all the hyperpo- 
larizing regions are in out-of-phase. These oscillations become periodic as we approach Gc = 20nS. 
For the range 25nS < Gc < 50nS the oscillations become chaotic again, but out-of-phase bursting 
behavior is sustained. In the range bOnS < Gc < ISOnS* the oscillations are periodic with bursts 
out-of-phase, and the bursting frequency decreases as we increase the coupling. For Gc > 150nS 
chaotic spiking-bursting out-of-phase behavior is observed, and the average burst length increases as 
we increase the coupling up to Gc = bOOnS. 
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FIG. 8. Excitatory chemical coupling of two chaotic ENs. Characteristic time series of the 
membrane potentials xi{t),X2{t) (figure labels A to C). Phase portraits X2{t) vs. xi{t) (figure labels 
al to cl). Phase portraits after 20Hz low pass filtering X2(t) vs. x{{t) (figure labels a2 to c2). 
(A) Gc = lOnS'-chaotic but nearly synchronized bursting behavior. (B) Gc = lOOnS'-periodic and 
synchronized bursting activity of the ENs. (C) Gc = 200 -periodic and synchronized activity with 
long bursts and spikes vanishing before the end of the bursts. 
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FIG. 9. Inhibitory chemical couphng of two chaotic ENs. Characteristic time series of the 
membrane potentials xi{t), X2{t) (figure labels A to F). Phase portraits X2{t) vs. xi(t) (fig- 
ure labels al to fl). Phase portraits after 20Hz low-pass filtering vs. (figure labels a2 
to f). (A) Gc = SnS'-chaotic oscillations with all hyperpolarizing regions out-of-phase. (B) 
Gc = 20nS'-periodic pattern with hyperpolarizing regions out-of-phase and some burst superposi- 
tion. (C) Gc = 25nS'-chaotic oscillations. (D) Gc = 50nS'-periodic out-of-phase bursting behavior 
with some burst superposition. (E) Gc = lOOnS'-periodic out-of-phase spiking-bursting behavior. 
(F) Gc = SOOnS'-chaotic out-of-phase spiking-bursting pattern. The time scale used in the time 
series plot is the same for all examples. 
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FIG. 10. Electrical coupling of an EN and a living pyloric dilator (PD) neuron from the stom- 
atogastric ganglion (STG) of the lobster Panulirus interruptus. Characteristic time series of the 
membrane potentials xi{t), X2(t) (figure labels A to C). Phase portraits of X2{t) vs. xi{t) (figure 
labels al to cl). Phase portraits after 20Hz low-pass filtering X2{t) vs. x({t) (figure labels a2 to 
c2). (A) Negative coupling-out-of-phase bursting activity. (B) Uncoupled neurons. (C) Positive 
electrical coupling-synchronized bursting behavior 
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